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Abstract 

Let S be a set of transpositions such that the girth of the trans- 
position graph of S is at least 5. It is shown that the automorphism 
group of the Cayley graph of the permutation group H generated by 
S is the semidirect product R(H) x Aut(H, S), where R(H) is the 
right regular representation of H and Aut(H,S) is the set of auto- 
morphisms of H that fixes S setwise. Furthermore, if the connected 
components of the transposition graph of S are isomorphic to each 
other, then Aut(iJ, S) is isomorphic to the automorphism group of the 
line graph of the transposition graph of S. This result is a common 
generalization of previous results by Feng, Ganesan, Harary, Mirafzal, 
and Zhang and Huang. As another special case, we obtain the auto- 
morphism group of the extended cube graph that was proposed as a 
topology for interconnection networks. 



Index terms — Automorphisms of graphs; transpositions; Cayley graphs; 
extended cube graph. 



1 Introduction 

Let T = (V, E) be a simple, undirected graph. An automorphism of T is a 
permutation of the vertex set that preserves adjacency, i.e. 7r G Sym(V) is an 
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automorphism of V if {u, v } G E iff {u n , v n } G E. The set of automorphisms 
of the graph V forms a permutation group, which we denote by Aut(T). 

Let if be a group and S C. H. The Cayley digraph of the group H with 
respect to S, denoted by Cay (if, S), is the digraph with vertex set if and arc 
set {(h, sh) : h G if, s G S}. When S is closed under inverses, (g, h) is an arc 
of the digraph Cay(if , S) if and only if (h, g) is also an arc. In this case, we 
identify the two arcs (g, h) and (h, g) with the undirected edge {h, g}. When 
the identity element e of if is not in S, the Cayley graph Cay (if, 5*) has no 
self-loops. Thus, when e S = S" 1 , the Cayley digraph Cay(if , S) can be 
considered to be a simple, undirected graph. A Cayley graph Cay (if, S) is 
connected if and only if S generates if. 

The automorphism group of the Cayley graph Cay (if, S), denoted by 
G := Aut (Cay (if, S)), contains the right regular representation R(H) as a 
subgroup; hence all Cayley graphs are vertex-transitive [TJ. The holomorph 
of a group if is defined as the normalizer in Sym(ff) of R{H) and can be 
shown to be equal to R (if ) Aut (if ). If G denotes Aut(Cay(if, S)), then 
the normalizer in G of R(H) equals N G (R(H)) = R(H) Aut (if, S), where 
Aut (if, S) is the set of automorphisms of if that fixes 5* setwise (cf. [TB]). 
Note that ff(if) and Aut(if, S) are always subgroups of Aut (Cay (if, S)); 
in fact, Aut (if, S) is a subgroup of the stabilizer G e in G of e ([I]). Thus, 
ff (if ) Aut(if, S 1 ) < G. If equality holds, then Aut(Cay(if, 5")) is the semidi- 
rect product ff(ff) x Aut (H,S). In this case, we call the Cayley graph 
Cay(if, S) normal since R{H) is a normal subgroup of automorphism group 
of the Cayley graph. Thus, normal Cayley graphs are those that have the 
smallest possible full automorphism group R(H ) x Aut (if, 5*). An open prob- 
lem in the literature is to determine which Cayley graphs are normal. By [16] 
and [7], the automorphism group G of a Cayley graph Cay (if, S) is equal to 
the semidirect product ff(ff) x Aut (if, S) if and only if G e C Aut (if ). 

In the present paper, we consider the generator set S to be a set of 
transpositions. Given a set of transpositions S, the transposition graph of 
S is defined to be the graph whose vertex set is the support of S, and two 
vertices i and j are adjacent in this graph whenever (i, j) G S. For eg, if 
S = {(1, 2), (2, 3), (1, 3)}, then the transposition graph of S is a triangle on 
vertex set {1,2,3}, and if := (S) = S3 and Cay(if , S) = K^ 3 . In this case, 
S is not a minimal generating set for if. A generating set S for ff = (S) is 
minimal if and only if the transposition graph of S is a tree [8] . The Cayley 
graph of the permutation group generated by a single transposition is trivially 
understood, so we shall assume henceforth that S is a set of transpositions 
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that contains at least two elements. 

We recall the results from the literature on the automorphism group of 
Cayley graphs generated by transposition sets. Let S be a set of trans- 
positions generating the symmetric group S n ] in other words, suppose the 
transposition graph of S is connected and has vertex set {1, ...,n}. Let 
G denote the automorphism group of the Cayley graph Cay(S n , S). When 
the transposition graph is an asymmetric tree, Godsil and Royle [5] showed 
that G = S n . Zhang and Huang studied the case where the transposition 
graph is a path graph ([IT]) and where the transposition graph is a star 
([IT]). Feng [3j showed that Aut(S n ,S) is isomorphic to the automorphism 
group of the transposition graph of S when n > 3; this holds even if the 
transposition graph of S contains cycles or is not connected. In the spe- 
cial case when the transposition graph of S is a tree, Feng [3] also showed 
that G = R(S n ) x Aut(S n , S). Ganesan [6 J showed that if the girth of the 
transposition graph is at least 5, then G = R(S n ) x Aut(5 n , S). 

For a graph T, let G v denote the set of automorphisms of T that fix the 
vertex v, and let L v denote the set of automorphisms of T that fix the vertex 
v and each of its neighbors. Then, L v < G v [JJ. Ganesan [5] showed that if 
the transposition graph of S is connected and has girth at least 5, then the 
stabilizer L v is trivial and Cay(5' n , S) is normal, whereas if the transposition 
graph is a 4-cycle, then L v is isomorphic to the Klein 4- group Z 2 x Z 2 and 
hence is nontrivial. Thus, this Cayley graph Cay (£4, S) is not normal. 

In all of the papers mentioned above on Cayley graphs generated by 
transpositions, the set of transpositions S is assumed to generate S n . In the 
present paper, we consider the more general case where S does not neces- 
sarily generate S n , i.e. the transposition graph of S C S n is not necessarily 
connected. Let H < S n be the permutation group generated by S. Each 
connected component in Cay(S' n , S) is isomorphic to Caj(H, S) and has as 
its vertex set a right coset of H in S n . The r-dimensional hypercube graph 
is defined as the Cayley graph of the permutation group H generated by r 
disjoint transpositions, i.e. the transposition graph of S consists of r disjoint 
edges K 2 and H = V 2 . Harary [TU] determined the automorphism group 
of the hypercube graph to be exponentiation group, and Mirafzal [H] used 
a different method to show that the automorphism group of the hypercube 
graph is Z 2 X S r . 

The objective of the present investigation is to seek a common general- 
ization of the results mentioned above on the automorphism group of Cayley 
graphs generated by transpositions to the case where the transposition graph 
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of S may contain more than one connected component (such as in the case 
of the hypercube graph mentioned above), but each connected component 
might be more general than just being a single edge K2. For example, each 
component of the transposition graph of S could be a path graph of arbitrary 
length, in which case the corresponding Cayley graph is called the extended 
cube graph. This graph was proposed in [T2j p. 384] as a topology for in- 
terconnection networks. A special case of the main theorem in the present 
paper gives the automorphism group of this extended cube graph. 

When choosing a graph as the topology of an interconnection network, 
it is desired that the graph have a high degree of symmetry. To that end, 
the symmetry properties of topologies proposed for interconnection networks 
have been extensively studied; for example, the automorphism group of 
the following topologies of interconnection networks have been studied: the 
bubble-sort graph [TT], the star graph [TT], the modified bubble sort graph 
[TT] . the derangement graph [3], the folded hypercube [H], and the alternat- 
ing group graph [18]. Besides the automorphism group, other properties of 
Cayley graphs generated by transposition sets have also been investigated; 
see for example, the papers by Cheng, Liptak and their coauthors [13], [2J- 

Given a simple, undirected graph Y = (V, E), the line graph of T is defined 
as the graph with vertex set E, and with two vertices being adjacent in the 
line graph whenever the corresponding two edges share a common endpoint 
in T. 

In Section [2] we state the main result of this paper and mention some 
corollaries and special cases. Section [3] contains the proof of the main theo- 
rem. 

2 Main results 

The main result of this paper is the following theorem: 

Theorem 1. Let S be a set of transpositions such that the girth of the trans- 
position graph of S is at least 5. Then, the automorphism group of the Cayley 
graph of the permutation group H generated by S is the semidirect product 
R(H) x Aut(if, S), where R(H) is the right regular representation of H and 
Aut(H,S) is the set of automorphisms of H that fixes S setwise. Further- 
more, if the connected components of the transposition graph of S are iso- 
morphic to each other, then Aut(H,S) is isomorphic to the automorphism 
group of the line graph of the transposition graph of S. 
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We now mention some corollaries and special cases of the theorem. For 
convenience, we let T = T(S) denote the transposition graph of S, and 
suppose that T consists of r disjoint copies of some connected graph T whose 
girth is at least 5. 

First consider the case where the transposition graph of S is a tree on 
three or more vertices. The permutation group H is the symmetric group S n 
for some n > 3. In this case r = 1 since the transposition graph consists of 
a single connected component. By Theorem [TJ the automorphism group of 
Cay(5' n , S) is R(S n ) x Aut(S' n , S), which is the result given in Feng [3]: 

Corollary 2. (^j) Let S be a set of transpositions such that the transposition 
graph of S is a tree on n vertices, where n > 3. Then Aut(Cay(S' n , S)) = 
R{S n )xAut{S n ,S). 

Ganesan [6] strengthened this result by showing that a sufficient condition 
for normality of Cay(S n , S) is that the connected transposition graph of S 
have girth at least 5: 

Corollary 3. (JE/) Let S be a set of transpositions such that the transposition 
graph of S is a connected graph on n vertices and has girth at least 5, where 
n > 3. Then Aut(Cay(S n , S)) = R(S n ) x Aut(S n , S). 

When the transposition graph of 5* is the n-cycle graph, the Cayley graph 
C&y(S n , S) is called the modified bubble sort graph. Zhang and Huang [TT] 
showed that the automorphism group of this graph is D2 n S n . Actually, it 
is shown in Ganesan [6] that this result is true if and only if n > 5 (the 4- 
cycle transposition graph causes a strictly larger automorphism group). By 
Theorem [U when n > 5, the automorphism group of Cay(S' n , S) is R(S n ) x 
Aut(S n , S), where Aut(S' n , S) = D 2n : 

Corollary 4. (J^j/) Let S be a set of transpositions such that the transposition 
graph of S is an n-cycle graph, n > 5. Then Aut(Cay(5' n , S)) = R(S n ) x D 2n . 

When the transposition graph of S consists of r independent edges (i.e. 
T = rK 2 ), the line graph of the transposition graph of S is K r . The permu- 
tation group H := (S) is isomorphic to Z^. By Theorem [TJ it follows that 
the automorphism group of the hypercube is 1I 2 y\ S r ^ which is obtained in 
Harary [10] and also given explicitly in Mirafzal [T4"| p. 6]: 

Corollary 5. ([TUf, [T^) The automorphism group of the r-dimensional hy- 
percube graph is isomorphic to x S r . 
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Frucht's theorem [5] states that the automorphism group of r disjoint 
copies of a connected graph T is the wreath product SV[Aut(r)]. If the 
transposition graph T(S) on vertex set {1, . . . , n} is not connected, then the 
permutation group H generated by S is a proper subgroup of S n . Then the 
Cayley graph Cay(S' n , S) consists of £ := \S n : H\ connected components. 
Each of these connected components is isomorphic to Cay (if, S) and has as 
its vertex set a right coset of if in S n . Thus, the automorphism group of 
Cay(S' n , S) can be obtained from the automorphism group of Cay (if, S): 

Corollary 6. Let S be a set of transpositions in S n generating if such that 
the transposition graph of S consists of disjoint copies of some connected 
graph having girth at least 5. Then Aut(Cay(S" n , S)) is isomorphic to the 
wreath product S'^[Aut(Cay(ii", S))] = Se[R(H) x Aut(if, S)}, where £ is the 
index of H in S n . 

Suppose the transposition graph T = T(S) consists of r copies of P3, the 
path graph on 3 vertices. Then Cay(if , S) is called the extended cube graph 
of dimension r, which was proposed in [T21 p. 384] as a topology of intercon- 
nection networks. The line graph of T is rP 2 , which by Frucht's theorem has 
automorphism group SV^]- Furthermore, the permutation group H gener- 
ated by S is isomorphic to the direct product of r copies of 5*3. Thus, the 
automorphism group of the extended cube graph is isomorphic to S3 x SVfSV]. 
This result can be generalized further to other extensions of the cube graph, 
for example, from path graphs on 3 vertices to path graphs on 3 or more 
vertices, or to disjoint copies of other kinds of graphs. For k > 3, define 
the extended cube graph of dimension (r, k) to be the Cayley graph of the 
permutation group H generated by a set of transpositions S whose transpo- 
sition graph consists of r disjoint copies of a path graph on k vertices. Then, 
we have: 

Corollary 7. The automorphism group of the extended cube graph of dimen- 
sion (r, k) is isomorphic to S r k x S r [S2] ■ 

3 Proofs of main results 

Throughout, S denotes a set of transpositions, H denotes the permutation 
group generated by S, and e denotes the identity element in H. 
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Theorem 8. Suppose S is a set of transpositions generating if satisfying the 
following two conditions for all t, k G S,t ^ k: 

(i) tk = kt if and only if there is a unique J^-cycle in Cay (if, S) containing 
e, t and k. 

(ii) If tk 7^ kt, then there is a unique 6-cycle in Cay (if, S) containing e,t,k 
and a vertex at distance 3 from e. 

Then, Aut(Cay(if, S)) ^ ff(ff) x Aut(H,S). 

Proof: Let G denote the automorphism group of the Cay ley graph Cay (if, S). 
By Xu [T6J Proposition 1.5], G = ff(ff) xi A ut (if, S) if and only if the sta- 
bilizer subgroup G e C Aut (ii). Let a G G e . It suffices to show that cr is 
an automorphism of if. Since a is an automorphism of the Cayley graph 
Cay (if, S), a is a bijection from the vertex set if of the graph to itself. 

To prove that the map o from ff to H is a homomorphism, we in- 
duct on the length of a word in if in terms of the generator elements. Let 
Si, s 2 , . . • , Sfc G S. We prove by induction on k that (si ■ • • Sk) a = sf • ■ ■ s£. 
This is clearly true for k — 1. Since S* satisfies conditions (i) and (ii) given in 
the hypotheses, by the proof given in [U p. 71], (sis 2 ) cr = s°s?,. Now suppose 
that for all a G G e , (si ■ • • Sk~i) a — s° • • • sl_ r Define z := Sk, y := (s^)^ 1 , 
and let r z and r y denote right translation by z and y, respectively. Observe 
that (si • • • s k ) a — si ■ ■ ■ s% if and only if (si • • • s Jt _i) rz<7r! ' = s£ • • • s£_ r Since 
g^o-ry _ ( Sfc )°- r !/ — (s£)y = e, r 2 crr y G G e satisfies the inductive hypothesis. 
Thus, ( Sl • • • s^Y^y = { Sl y^ y . . . = a? . . . 8 «_ v t 

A special case of the next lemma is proved in Godsil and Royle [H Lemma 
3.10.3], where it is assumed that S is a set of transpositions such that the 
transposition graph of 5* does not contain triangles. The lemma remains 
valid even if the transposition graph of S contains triangles: 

Lemma 9. Let S be any set of transpositions and let H be the permutation 
group generated by S . Let t, k G S,t ^ k. Then, tk = kt if and only if there 
is a unique J^-cycle in Cay(if, S) containing e,t and k. 

Proof: Suppose tk = kt. Then t and k have disjoint support. Let w be a 
common neighbor of the vertices t and k in the Cayley graph Cay (if, S). By 
definition of the adjacency relation in the Cayley graph, there exist x,y G S 
such that xt = yk = w. Observe that xt = yk iff tk = xy. But since k and t 
have disjoint support, tk = xy iff t = x and k = y or t = y and k = x. Thus, 
w is either the vertex e or the vertex tk. Hence, there exists a unique 4-cycle 
in Cay (if, S) containing e, t and k, namely the cycle (e, t, tk = kt, k, e). 
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To prove the converse, suppose tk ^ kt. Then t and k have overlapping 
support; without loss of generality, take t = (1,2) and k = (2,3). We 
consider two cases, depending on whether (1,3) G S. First suppose (1,3) ^ 
S. Let w be a common neighbor of t and k. So w = xt = yk for some 
x,y e S. As before, = yk iff xy = tk = (1,2)(2,3) = (1,3,2). The 
only ways to decompose (1,3,2) as a product of two transpositions is as 
(1,3,2) = (1,2)(2,3) = (3,2)(1,3) = (1,3)(1,2). Since (1,3) £ S, we must 
have x = (1, 2) and y = (2, 3), whence w = e. Thus, t and k have only one 
common neighbor, namely e. Therefore, there does not exist any 4-cycle in 
Cay(if, S) containing e,t and k. 

Now suppose r := (1,3) G S 1 . Then S contains the three transpositions 
t = (1,2), k = (2,3) and r = (1,3). The Cayley graph of the permutation 
group generated by these transpositions is the complete bipartite graph ^3,3. 
Hence Cay (if, S) contains as a subgraph the complete bipartite graph K 3j3 
with bipartition {e,kt,tk} and {t,k,r}. There are exactly two 4-cycles in 
Cay (H, S) containing e,t and k, namely the 4-cycle through the vertex kt 
and the 4-cycle through the vertex kt. Thus, while there exists a 4-cycle in 
this case, it is not unique. | 

If H' is a permutation group containing H, then the Cayley graph Cay(if', S) 
contains the Cayley graph Cay (if, S) as one of its connected components. In 
fact, the vertex set of each connected component of Cay(if', S) is one of 
the right cosets of H in H'. Thus, there is a unique 4-cycle in Caj(H', S) 
containing e, t and k if and only if there is a unique 4-cycle in Cay(if , S) 
containing e, t and k. 

Theorem 10. Let S be a set of transpositions such that the girth of the 
transposition graph is at least 5. Then the automorphism group of the Cayley 
graph of the permutation group H generated by S is the semidirect product 
R(H) x Aut(H,S). 

Proof: It suffices to prove that if S is a set of transpositions such that the 
girth of the transposition graph of S is at least 5, then conditions (i) and 
(ii) of Theorem [H] are satisfied. Let t,k G S,t ^ k. By Lemma [HJ tk = kt 
if and only if there is a unique 4-cycle in Cay(if, S) containing e,t, and k. 
Thus, condition (i) of Theorem [8] is satisfied. For the special case where the 
transposition graph of 5" has girth at least 5 and is a connected graph, it is 
shown in [6] that there is a unique 6-cycle in Cay(if, S) containing e, t, k and 
a vertex at distance 3 from e. It can be checked that this identical proof goes 
through even if the transposition graph of 5" is not connected since this proof 
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in [5] does not use the assumption of connectivity of the transposition graph. 
Thus, condition (ii) of Theorem |S] is also satisfied. Hence, Aut(Cay(if, S)) = 
R(H) x Aut(H,S).§ 

Proposition 11. Let S be any set of transpositions, and let H be the per- 
mutation group generated by S . Then, every automorphism of H that fixes 
S setwise, when restricted to S, is an automorphism of the line graph of the 
transposition graph of S. 

Proof: Let 7r £ Aut(iJ, S). Let t,k £ S,t ^ k. Since 7r is an automorphism 
of H, it takes tk to (tk) n = t n k w . An automorphism of a group preserves 
the order of the elements, whence t and k have disjoint support if and only 
if t n and k n have disjoint support. Since 7r fixes S, t n , k n £ S. Thus, in 
the transposition graph of 5*, the edges t and k are incident if and only if 
the edges t n and k n are incident. In other words, ir restricted to 5* is an 
automorphism of the line graph of the transposition graph of S. | 

Theorem 12. Let S be a set of transpositions such that the connected com- 
ponents of the transposition graph of S are isomorphic to each other and 
have girth at least 5. Let H be the permutation group generated by S . Then, 
Aut(H,S) is isomorphic to the automorphism group of the line graph of the 
transposition graph of S. 

Proof: For simplicity of exposition, we denote the transposition graph of S 
by T = T(S) and its line graph by L(T). By hypothesis, the transposition 
graph T consists of r disjoint copies of some connected graph T for some 
positive integer r, and the girth of T, which equals the girth of T, is at least 
5. 

If T has exactly 2 vertices, then T is the single edge K 2 . In this case, 
the line graph of T = rK 2 is K r and has automorphism group S r . The 
permutation group H generated by r disjoint transpositions is isomorphic 
to Z^. Any automorphism of H is uniquely determined by its image of 
the r generator elements, and hence Aut(H,S) has at most r! elements. 
Conversely, every permutation of these generators 5* can be extended to a 
unique automorphism of H. Thus, Aut(if , S) = S r . We have shown that that 
the assertion Aut(if, 5*) = Aut(L(T)) is true if each connected component V 
of the transposition graph T has exactly 2 vertices. 

For the rest of the proof, suppose each connected component T of the 
transposition graph T has at least 3 vertices. In view of Proposition [TTJ, we 
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can define the map ip : Aut(H, S) — > Aut(L(T)) that takes o G Aut(if, 5*) 
to a restricted to S. We denote the image of a by a\ s . We show if) is an 
isomorphism. It is clear that ip is a homomorphism. Also, a homomorphism is 
completely determined by the image of the generators, so that a G Aut(i7, S) 
is completely determined by its action on 5*. Thus, ip is injective. We prove 
next that ip is onto. Let r G Aut(L(T)). Our objective is to show there 
exists an element a G Aut(if, S) such that a|5 = r. 

Given r G Aut(L(T)), we claim that there exists a unique element o' G 
Aut(T) that induces r. We first consider the case where T consists of just 
one connected component. It is clear that for any two graphs T,T', an 
isomorphism from T to T' induces an isomorphism from L(T) to L(T'). 
Whitney [T5] showed that if T, T' are connected graphs on at least 5 vertices 
such that their line graphs L(T),L(T') are isomorphic, then T,T' are also 
isomorphic unless one is a triangle K3 and the other is a star Ki^. In 
particular, it can be shown (cf. [9, p. 73]) that if T, V are connected graphs 
on at least 5 vertices, then for every isomorphism (pi from L(T) to L(V), 
there is exactly one isomorphism </> from T to T' that induces <pi. Setting 
T' to equal T, it follows that if the transposition graph T is a connected 
graph on at least 5 vertices, then for every automorphism r of L(T) there is 
a unique automorphism a' of T that induces r. Therefore, the automorphism 
group of T and of its line graph L(T) are isomorphic. If T is a connected 
graph on 3 or 4 vertices, then by the hypothesis on the girth of T, T is a 
tree. In this case, the claim can be verified for each tree. This proves the 
claim if T consists of just one connected component. 

If T consists of r disjoint copies of some connected graph T, then each 
connected component of L(T) corresponds to a connected component of T. 
By the same argument given for the r = 1 case, it follows that for every 
automorphism r of L(T), there exists an automorphism o' of T that induces 

T. 

The vertex set of T is the support of H, call it {1, . . . ,n}. Thus, H = 
(S) < S n . Given r G Aut(L(T)), we showed there exists an element a' G 
Aut(T) such that a' induces r. Given this a', let c(cr') denote conjugation 
by a'. Thus, c(cr') G Aut(S' n ). Since a' is an automorphism of T, it fixes the 
edge set S of T. Hence, c(a') G Aut(5'„,5'). Define a := c(cr')|#. Then a 
is an automorphism of H that fixes 5* setwise. Also, a\s = t. For example, 
if r takes {i,j} to {m,£}, then there exists a a' G S n that takes to 
{cr'(i), cr'(j)} = {""i,^}- Then c(cr') takes (z,j) G S to (m, £) G S\ Thus, 
c(cr')|// and r induce the same permutation of S, which implies ip is onto. 
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We have shown that Aut (if, S) = Aut (L(T)). | 
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